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Photogram met ry 


Using photos for measurements and, in our case, modelling/texturing. 
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The End 
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The beginning: research and development 


T 


• Scanning t 

• Mentality and workflows • 

• Game assets in a "photogrammetry world" 

• Terrain 


plans and goals 


Level Construction Kits 


Key learnin 


eaways 
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Big Changes 


• New console generation 

• New franchise 

• Very high expectations to deliver after BF4 

• A clean slate; we want to do it right! 








Challenges 


Star Wars! 

Learning 
jpotogra 
A really tight sch'ed 
If we're saying 60,, 
Keeping it together 


jrom t 
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Dev Structure 


• 3 month development cycles 

• Content development until the end 

• Need for 2 week buffer discovered 

• Approval lock 

• Stabilization 




The beginning 
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Scan everything!..? 

• Bridge the gap between scanned characters and their surroundings. 

• Make the best looking Star Wars game ever! ..at 60fps © 

• We have so little time... 
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Capture the 
Focus and c 
Capture me; 
Visit the rea 
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Capturing on locatic 


Simple kit (24mm lens, Canon 6D, tripodf coig 
Ideal weather conditions 
On-location breakdown 
Thinking in terms of usable pieces 
Aware of Frostbite strengths/weaknesses 
Focus on quality over cfu|ntity of captures 
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A. Dirt ground 

B. Leaves and twigs 

C. Clover ground 

D. Clover leaves 

E. Fern large 

F. Fern medium 

G. Fern small 

H. Log large 

I. Log medium 

J. Log small 

K. Tree large 

L. Tree medium 

M. Tree small 

N. Tree stump 

O. Vegetation 






1 mm 




Overlap!! 

Covering ^//angles to reduce cleanup. 

Avoid cast shadow - ambient light is easily removed 
Most reliable results occurred when full asset was/visl 
Avoid objects with too intricate details. 

Be sure that all capture methods are consistent an 

Prepare yourself and eqinpment for various condijiqn 
the process sloppy aftjdfdestroy consistent results. 


in the process, 
most photos. 


ther can make 


Best practi 
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Capturing the planets 
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Successful location scanning 

• A small and manageable group with light equipment is ideal. 

• Structured and focused on location. 

• Absolutely key to connect and understand how to recreate real locations. 





Managing the data 

• Over 100,000 photos to manually sort 

• Over 2000 assets to manually review 

• Over 14 hours of video to categorize 

• Less than ideal storage solution 

• A lot of room for improvement here! 
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Workflow 


. ri 


f , 



. ■ ' * 

• , *.*-*'• * - 

i ; - 

> / , '/» u jr * / 

; W ' V- : 4' ' - 




W 7 „ 


^ - ■ v 

\ * ' ~ » , 'S ' ' s _ ■•.'■” 

* / ' '. * ' " cr • -JX "» 


_ ’ - . .*#•* '.■ < 
fl 'H • 

» -••■ ' '- 5 , ■ ■ 

2i 

^r^Jr .■*■ ■- • . 

■■■r ■■ :"■. •> •: •••• •• ••., 







Workflow 


Now we have the data, so let's go. 
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How long does an asset take? 

Is Photogrammetry a savings? (Straw Poll) 


Days Per Asset 

0 2 4 6 8 10 12 14 16 



■ High Poly ■ Re-Topo ■ UV Layout ■ Texture ■ Setup 
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How long does an asset take? 

With Automation 



■ High Poly ■ Re-Topo ■ UV Layout ■ Texture ■ Setup 





Photogram met ry workflow 

• Remove vignette, keep lens distortion. 

• Batch calibration to color chart. 

• This entire step should be automated! 


PS Camera RAW 
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Photogram met ry workflow 


□ ICE 


Most assets need to be masked - very time consuming if not automatic. 
Baking at High gave most useable and manageable results for Objects. 
Baking at Ultra gave best results for Terrain - files are huge though. 



Photogram met ry workflow 

• Mosaic rather than Average blend gives much sharper results. 

• Shredded UVs - take to Zbrush and reproject, or bake high res. 



Photogram met ry workflow 

• Some assets completely automated in MeshLab. 

• Some needed fine tuning in Topogun - ok if very limited asset library. 




Photogram met ry workflow 

• Detail textures applied later means UVs demand very little stretching. 

• UV direction important for consistent detail texture alignment, sometimes 
may need a second UV just for detail tiling. 





Photogram met ry workflow 

• Color, Tangent Normals, Object Normals, Heightmap, AO, Cavity. 





Photogram met ry workflow 

• Object Space Normals used as a mask to remove ambient lighting. 

• AO or cavity map for fine tune lighting removal. 






Photogram met ry workflow 


Light Removal 
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Light Removal 

Object Normal 

• In this example, shadows are not 
so distinct 

• Generate an object normal map 

• This gives distinct colors for the 
different object normals 


□ic= 




Light Removal 

Object Normal 

Using Black & White mask in 
Photoshop you can pull out 
different "directions" 
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Workflow 


Now we have the base "source" data... 
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Texel Density 

• Graphical representation of a pixel 

• An initial pitfall for us 

• The following screenshots are 1080p 

• Illustrates texture pixel (texel) to screen 
pixel ratio 
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10 texture pixels per screen pixel 


(excluding mips) 
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For Comparison: 
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For Comparison: Two lk Textures. 3.7mb 
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Texel Density 

Takeaways 

• You'd be surprised what you can get away with 

• Detail maps are our friends 

• Large textures have a very big streaming overhead 

• We have an 800mb texture pool on Gen4 



Texture Arrays 

• The photoscanned asset as a base is generally quite low res. 

• All environmental assets use a consistent preset shader. 

• Planet-specific Texture Array instance shaders add the detail on top. 



Object Preset Shader 



DetailTiling 
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Texture Arrays 

• This texture array instance shader is set up for normal, reflectance, and 
color. 



Texture Array Instance Shader 
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Texture Arrays 


• Brightness is painted in 5 even steps (as there are 5 detail textures). 

• The order of these layers must correspond to the order in the Array. 


Brightness % 
0 

25 

50 

75 

100 
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Detail 

Leaves 

Bark 

Burnt Bark 

Rock 

Moss 


Tree Normals (Texture Array mask in Alpha) 





Texture Arrays 


□ ICE 


Detail textures are fading away towards the end of LODO with 'LodFade' 
LODI has a new simplified shader without detail textures. 


Texture Array Instance Shader 
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Texture Arrays 

• Like most texture assets in Battlefront, we heavily pack into channels. 

• The detail texture uses RG for normals, B for Reflectance, A for Color. 


Detail Texture within the Texture Array 





Texture Arrays 

• Unique PhotoScan base is surface blurred, 
while keeping important details. 

• Drastically reduces texture memory. 






Texture Arrays 

• Texture Array tiling detail on top fill in the 
details without overpowering the base. 

• Drastically increases texture resolution. 






QUALITY 



EFFORT 







PBR 

Quick Thoughts _ : 

• Helps us bridge that gap 

• Lessons from Criterion, Guerilla Games, Dontnod etc 

• Trying to get everyone to switch together can backfire 

• Some people will adapt instantly. Let them lead! 

• For PBR, there isn't really a middle road. ^ 




inconsistencies 
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Light + Indirect 
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Reaching 60fps - lets make a dense forest! 

Difficult to get good results from scanned vegetation^- complex and 
noisy, resulting in horrible scans. ^ 

Limited vegetation needs meant creating by hand was an option. 

Based on photos of vegetation from location captured on blue boardr^^A 

Integrating hand-built vegetation into a PhotoScanned wofld,was tough ^ 
to reach comparable quality! 
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Vegetation 


All vegetation share the same textures 


There are textures created separately for 
close up, mid, and far distances. 

There is a lot of texture packing within 
vegetation assets to reduce complexity of 
shaders. 

MipMaps tweaked for visual control. 

Normals created by broadly modelling 
around leaves and branches Maya. 
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Vegetation 


• Unique PhotoScanned base blends to tiling 
texture that extends upwards. 

• Tree base is generally evenly tessellated for 
best displacement results. 




Terrain/asset blending 

• A lot of work put in to reduce the visible 
disconnect between assets and terrain. 

• Most assets have terrain radiosity 
projected on to them. 

• Texture Arrays world projected and details 
match. 

• Terrain color and normals applied to most 
assets. 
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Terrain/asset blending 

• A lot of work put in to reduce the visible 
disconnect between assets and terrain. 

• Most assets have terrain radiosity 
projected on to them. 

• Texture Arrays world projected and details 
match. 

• Terrain color and normals applied to most 
assets. 
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Mesh Displacement 

• Great quality boost for close up detail. 

• Object displacement stopped at ~7 meters. 

• An ongoing balance between quality and 
performance. 
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Pi' ' 

Tessellation and 

Heightfield Displacement 

• Quality vs. Speed ratio is extremely high 

• Feel free to get creative 



Photogrammetry 
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Processing the data 






Processing the data 



100 x 80 km 
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Texture Capture 
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Terrain Tessellation 


• Great quality boost for close up detail on terrain 

• Major upgrade for us. Can never go back! 

• Terrain displacement stopped at ~15 meters. 
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Terrain Tessellation OFF 
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Terrain Tessellation ON 
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Best practices - Terrain 

• We aimed for 3x3 meter patches 

• 5x5 photo grid ensures enough overlap 

• Capture only 1 defined element at a time 

• Low ISO and high F-Stop for sharp image 

• Avoid noisy surfaces such as grass 
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Level Construction Kits 

• Content and documentation packages. 

• Provides fast level iteration. 

• Shifts focus to building levels rather than 
content during Production. 

• Allows us to more quickly understand 
performance and keep track of it. 
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Level Construction Kits 

• 8x8km highly detailed terrain. 

• Ready to paint terrain materials. 

• Easily accessible limited library of content. 

• Lighting presets based on the films. 
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Endor 


Hoth 


Tatooine 


Sullust 
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Key learnings and takeaways 

• Solid processes and workflows in place before Production was a big win. 

• Well planned and structured Photogrammetry trips results in clean and 
manageable assets. 

• Photogrammetry is not a silver bullet - it was only one part of achieving 
the final results in game. 

• Consistency is key when working with scanned assets - it was crucial to 
have artists own and be responsible for their locations/planets. 

• Working towards PBR was an ongoing process to success. 

• Much of our creative process was incredibly repetitive, much of which 
can and should be automated. 

• There was way too much manual labor, with levels being built by brute 
force without the help of workflow-improving tools. 
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Rendering Et 

- and of course, the entire Batttefronitearn at DICE! 
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